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ABSTRACT 

Significant changes that have occurred in the 
evaluation of overall faculty performance and classroom teaching 
performance Decween 1983 and 1988 are discussed from the viewpoint of 
a 1988 study that surveyed all accredited, four-year undergraduate, 
liberal arts colleges listed in the "Higher Education Directory". For 
years, faculty evaluation has carried the cachet of serving a useful 
purpose, Dut never before has it carried the make-or-Dreak intensity 
it does on the campus today. How an institution appraises a 
professor's performance has assumed new importance since a 
professional life may depend on it. Significant study findings 
include the following: classroom teaching is the most important 
consideration in the evaluation of overall faculty performance; 
systematic student ratings are the second most important information 
source in appraising classroom teaching performance, faculty 
committees are crucial in evaluating teaching; self-evaluation has 
picked up considerable support; and classroom visits have gained 
significantly in importance. Since 1983, only limited change has 
taken place in the evaluation of overall performance, but 
considerable change has occurred in the evaluation of classroom 
teaching. A direct outgrowth of improved evaluation practices will be 
improvement in teaching performance. Tables are included. (SM) 
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''PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 

_^Ainerican Assnr-f 
for Higher Education 

EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) ' 

AS the number of college 
professors awarded pro 
motion and tenure di- 
■minishes, many pro- 
fessors ponder with a sense of 
apprehension the evaluation crite- 
ria applied to them. Simultane- 
ously, many academic deans and 
department chairs ponder the 
validity of their promotion/tenure 
decisions 

For years, faculty evaluation 
has carried the cachet of serving 
a useful purpose, but never before 
has It carried the make-or-break 
intensity it does on campus today 

Why? One reason is faculty 
mobility is virtually a thing of the 
past. How an institution appraises 
a professor's performance has 
assumed new importance since 
a professional life may depend 
on it. For their part, colleges are 
under the gun of community and 
governmental groups to hold pro- 
fessors accountable for their 
performance 

To examine current evaluation 
policies and procedures, early 
in 1988 I surveyed all the accred- 
ited, four-year, undergraduate, 
liberal arts colleges listed in the 
Higher Education Directory 
To make the population more 
manageable, I excluded university- 
related liberal arts colleges. Of 
the 745 academic deans to whom 
I sent questionnaires, 604 (81 
percent) responded. The high 
rate of return probably reflects 
the troubled concerns over the 
^ ' usiness of faculty ratings. 
lEI^C Another purpose of the survey 
™™=W/as to uncover changes in insti- 
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Peter Seldin is a professor at 
Pace University, Department 
of Management, Pleasantville, 
NY 10570 Readers interested 
in more infonnation about the 
studies descri^' • bhoxild contact 
the author. 
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tutional policies and procedures 
since my last survey in 1983. For 
comparison's sake, the base data 
for both surveys were identical 

The questionnaire I used was 
first developed by the American 
Council on Education (ACE) in 
1967 and was revised by the Edu- 
cational Testing Service in 1977 
It was designed to gather data 
on the policies and procedures 
that guide institutions as they 
evaluate faculty performance for 
decisions on retention, promotion 
in rank, and tenure 

I expect that complete findings 
of the 1988 study wall be reported 
in other educational publications. 
In this article I want to focus on 
the significant changes that have 
occurred in the evaluation of over- 
all facult>' performance and class- 
room teaching performance in 
the last five years 



Evaluating performance 

When an institution considers 
a professor for retention, pro- 
motion, or tenure it weighs many 
factors. Thirteen factors were 
included in the questionnaire. 
The deans were asked to rate each 
factor as being a "major factor," 
a '*minor factor," '*not a factor," 
or '*not applicable " Table 1 sum- 
marizes the results. 

Even a cursory examination 
of the data reveals tnat things 
have not changed very much in 
five years. In fact, of the thirteen 
criteria, only the importance of 
research changed by as much 
as 5 percent. 



Attention paid to the other tra- 
ditional benchmarks of academic 
achievement— publication and 
activity in professional societies- 
continues unabated That pub- 
lished research and professional 
society activities continue to be 
important seems a reflection of 
the vigorous efforts by deans to 
capture the public eye for their 
faculty's scholarship 

In the words of one California 



; dean: "High visibility is the name 
of the game today. The state con- 
trols the budget, so we push the 
faculty to publish, publish, pub- 
lish," A Texas dean said bluntly 
"If the faculty doesn't publish, 
the college wil! perish 

Colleges seem to be pressing 
faculty to get involved in research, 
to publish journal articles, and 
to pr3sent papers at professional 
meetings. But at the same time, 



Table 1. Percentage of liberal arts colleges that consider each 
factor a "nnajor factor" in evaluating o»/era// faculty performance. 





1 00*5 


1 CkfkU. 


Factor 






Classroom teaching 


98 7 


99 8 


Supervision of 






graduate study 


37 


28 


Supervision of 






honors program 


1 9 


24 


Research 


33 4 


38 8 


Publication 


29 2 


29 4 


Public service 


174 


195 


Consultation 






(government, business) 


24 


24 


Activity in 






professional societies 


24 5 


24 9 


Student advising 


61 7 


64 4 


Campus committee work 


52 6 


54 1 


Lengtn of service in rank 


46 8 


43 9 


Competing job offers 


1 8 


1 8 


Personal attributes 


28 6 


29 4 
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Table 2. Percentage of liberal arts colleges that "always used" each 
source of information in evaluating faculty teaching performance. 



Source of information 

Systematic student ratings 
Informal student opinions 
Classroom visits 
Colleagues' opinions 
Scholarly 

research/publ i cat lo n 
Student examination 

performance 
Chair evaluation 
Dean evaluation 
Course syllabi and exams 
Long-term foHow-up 

of students 
Enrollment in elective courses 
Alumni opinions 
Committee evaluation 
^rade distribution 
3lf-evaluation or report 



1983 


1988 


(N=616) 


(N=604) 


67 5 


80 3 


11 5 


11 3 


198 


27 4 


43 3 


44 3 


27 3 


29 0 


36 


36 


81 3 


80 9 


750 


72 6 


20 1 


29 0 


34 


32 


1 1 


1 2 


39 


32 


46 1 


49 3 


45 


42 


41 9 


49 3 



they are not overlooking their 
faculty's on-campus activities. 
Campus committee work and 
student advising each remadn a 
"major factor " 

This suggests thai colleges are 
paying attention to students as 
customers— understandable given 
the economic stress under which 
many colleges find themselves 
Colleges are extending themselves 
to keep their students happy and 
in school 

For years, the factor '^personal 
attributes" has functioned as a 
convenient mechanism to ease 
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out of their jobs faculty members 
who are out of step v/ith the dean, 
the department chair, or col- 
leagues Unfortunately, it remains 
a often-cited ''major factor " This 
suggests that some faculty 
members will continue to be pun- 
ished for having the wrong 
friends, the wrong politics, or 
the wrong personality. 

Length of service in rank still 
earns substantial importance in 
a professor's overall evaluation 
Deans relying on this factor would 
likely argue that the longer one 
serves in a particular academic 
rank, the greater the value of 
one's contribution to the liter- 
ature That concept, however, 
may be challenged by younger 
professors, who see themselves 
more in tune with institutional 
and student needs 

As a Florida college dean wrote 
'The young faculty are still 
hungry They are the first to 
volunteer for college assignments 
They put in long hours advising 
students And theyYe the ones 
we turn to first for help " 

To assess change since 1983 
in the importance of the factors 
considered in overall assessment. 



I performed t*tests of differences 
in mean scores. Each question 
had called for one of four 
responses, and I assigned each 
response a numerical weight: 
"major factor" 1, "minor factor - 
2, "not a factor'*-3, and "not appli- 
cable"-3. 

To dete: mine the mean score 
for a far tor, I added its weights 
and divided the sum by the 
number of deans responding 
This ranking process, used by 
ACE in an earlier study, simplifies 
the process of identifying impor- 
tant factors. 

In fact, there is no statistically 
significant difference between 
the mean score in 1983 and in 
1988 for any of the thirteen fac- 
tors, although several trends are 
j evident. (These trends are espe- 
1 f ally clear when data irom my 
i 1978 survey are considered as 
! well.) 

j Yet, it does deserve noting that, 
I in mos" cases, the mean scores 
j are lower in 1988; that is, deans 
i are giving greater importance 
I to more factors in evaluating over 
\ all faculty performance. 

Despite the financial duress 
; under which so many institutions 
; operate, only limited change has 
■ taken place since 1983 in the eval- 
uation of overall performance 
. But, considerable change has 
i occurred in the evaluation of 
J classroom teaching performance. 



I Evaluating teaching 
i performance 

! Most colleges perceive with 
j pride the high caliber of reaching 
I offered by their faculty The per- 
I ception is demonstrated anew 
i by this study, in which classroom 
teaching is cited almost unani- 
mously as a "major factor'' in 
evaluating a faculty member s 
overall performance. 

It is reasonable to assume, then, 
that deans take considerable pains 
to locate relevant sources of infor- 
mation on teaching competence 
How do they assess such com- 
petence? What information sour- 
ces do they use? 

To find out, the questionnaire 
asked the deans to "Indicate the 
frequency with which each of 
the followdng types of information 
^ used in your college in eval- 
> i/^ ng a faculty member s teach- 



ing performance." The respon- 
dents had four possible responses, 
and, again, I assigned each a 
numerical weight: "always used"- 
1, "usually used"-2, "seldom 
used"-3, and "never used''-4. 
Table 2 displays the information 
sources and the percentage of 
deans who "always used" each 
source 

The evidence points to signif- 
icant changes in the ways liberal 
arts colleges assess information 
sources when evaluating teaching 
performance. Of the fifteen sour- 
ces, four changed by 7 percent 
or more since 1983, and, more 
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significantly, they all changed 
in the same direction. Each of 
these four sources of information 
is more widely used now 

The number of deans reporting 
they always rely on systematic 
student ratines has dramatically 
increased in the five years Today, 
perhaps for the fiij>l time, student 
ratings are more widely used to 
assess teaching than any other 
source of information except the 
department chair. 

The rapid growth in importance 
of student ratings has exacerbated 
the conflict over their value. A 
Nebraska dean argues: "Student 
ratings should never be used 
They can't be trusted," Opposed 
is a Massachusetts dean "Student 
ratings are the most trustworthy 
factor in evaluating teaching" 

What other information sources 
do institutions rely on? The other 
front-runners are still evaluations 
by the department cheiir and the 
academic dean. Of the two, the 
chair's is still predominant, and 
the gap is widening. 

Scholarly research/publication 
as an indicator of teaching per- 
formance has grown The growth 
dovetails with the emphasis on 
research and publication cited 



Table 3. T-tests of differences in mean scores of sources of 
information used in evaluating faculty teaching performance. 





1983 


1988 




Source of information 


(N=616) 


(N=604) 


t 


Systematic student ratings 


1 44 


1 25 


4 69* 


Informal student opinions 


241 


245 


-0 98 


Classroom visits 


243 


2 18 


4 54* 


Colleagues' opinions 


1 71 


1 74 


-0 77 


Scholarly 








research/publication 


2 23 


2 23 


-001 


Student examination 








pe'*ormance 


3 03 


3 06 


-0 67 


Chaii evaluation 


1 26 


1 27 


-0 25 


Dean evaluation 


1 36 


1 42 


-1 32 


Course syllabi and exam? 


2 22 


201 


4 10* 


Long-term follow-up 








of students 


315 


3 06 


1 71 


Enrollment in elective courses 


3 12 


321 


-1 91 


Alumni opinions 


3 08 


3 05 


0 70 


Committee evaluation 


2 06 


2 05 


012 


Grade distribution 


3 07 


3 03 


0 85 


Self-evaluation or report 


1 96 


1 78 


2 90* 



The test was a t-test »or differences in independent proportions 
'Significant at 01 level of confidence 



j earlier in the evaluation of overall 
! performance. 

Educators have argued for 
years whether research and pub- 
lication enhances the professor'':* 
classroom performance The 
argument has produced cons'd- 
erable heat but, unfortunately, 
very little light Some educ?;tors 
insist they cannot stimulace and 
be up-to-date in the classroom 
unless they are engagea in 
research. Others msist with equal 
fervor that college research only 
indirectly, if at all, relates to class- 
room teaching. 

Perhaps the argument needs 
tc be laid to resl If research and 
publication provides genuine 
insight into the professor's teach- 
ing effectiveness, it can be used 
to assess classroom competence 
Otherwise, it cannot. 

Table 3 displays the t-tests of 
differences in mean scores Anal- 
ysis mdicates statistically signif- 
icant differences at the .01 level 
of confidence in mean scores 
for four information sources, 
classroom visits, course syllabi 
and exams, self-evaluation or 
report, and systematic student 
ratings 

Classroom visits have won pop- 
ularity as an assessment tool The 
number of institutions incorpo- 
rating classroom visits as an 
important component in the eval- 
uation process has multiplied 
Yet, classroom visits remain a 
controversial subject To an llli 
nois dean ^'Classroom visits are 
the only way really to know what's 
going on behind closed doors " 
To a Texas dean "Classroom visits 
demean the teacher and have 
no value " 

Judgments on teaching per- 
formance are increasingly based 
on analysis of course syllabi and 
exams Central to this approach 
is scrutiny of such instructional 
items as course content, objec- 
tives, methodology, examinations 
and grading, course organization, 
and homework assignments. The 

; growing use of handouts, reading 

I lists, homework assignments, and 
student examinations and reports 
is consistent with today's trend 

■ toward more structured infor 

' mation gathering. 

! Self-evaluation has also 
achieved wide eminence as an 
appraisal technique. A host of 
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colleges are convinced that self- 
evaluation can and should play 
a stellar role in a multi-source 
evaluation process It can serve 
as a catalyst to increase self- 
awareness This, in turn, can sen- 
sitize the professor to the inter- 
ests of others, to catch unspoken 
clues to the behavior and needs 
of others 

At the same time, thp growing 
eminence of self-evaluation has 
heated up the debate over its 
value. Deans line up on both sides 
of the question In the words of 
a proponent Oregon dean* "We 
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think self-evaluation deserves 
great weight, the greatest weight, 
in the evaluation system " An 
opponent dean from Georgia 
"Self-evaluation is patently so 
self-serving, it's practically 
worthless " 



S(*\eral sifjiiifirant rnulinjis 

Clearly, a major stimulus to 
create a new and workable for- 
mula to rate a professor's per- 
formance is the admitted dissat- 
isfaction with the way deans 
currently evaluate faculty, li 
open-minded comments, many 
deans confessed frustration in 
their inability to get past half- 
success with their evaluation for- 
mulas Finding a satisfactory for- 
mula was elusive. 

As a Florida dean commented 
'This IS my fourth year as aca- 
demic dean Would you believe 
it, 1 still can't put together a good 
evaluation program " From an 
Ohio dean "We recognize that 
evaluations on this campus are 
too subjective, and we're working 
on it. It's not easy." From a North 



Carolina dean: 'We're making 
progress. It's slow going You lick 
one problem and another 
surfaces " 

Faculty evaluation may yet have 
a long way to go to perfect itself 
to the satisfaction of deaNs and 
professors, but it has undeniably 
traveled far !n today's account 
ability climate, it is unlikely to 
turn back 

A summing up of the more sig- 
nificant findings in the evaluation 
of overall faculty performance 
and classroom teaching per- 
formance in the 1988 study 
includes the following- 

• Classroom teaching continues 
as the most important consid- 
eration in evaluating overall 
faculty performance 

• Research, publication, and 
activity in professional societies 
are even more prominent today 
than previously (In 1978, only 
24.5 percent of deans rated 
research of "major" importance, 
only 19 0 percent rated publi- 
cation, and only 17 percent activ- 
ity in professional societies ) 

• The department chair is still 
the predominant information 
source in evaluating teaching 
performance 

• Systematic student ratings 
have climbed to second place as 
an information source in appreiis- 
ing classroom teaching perfor- 
mance (Student ratings were 

in third place in 1978, at 54 8 
percent.) 

• Evaluation by the academic 
c'oan IS not far behind student 
ratings, but it is losing ground. 
(In contrast, 76 9 percent of 
respondents in 1978 said dean 
evaluation was "always used," 
putting it in second place ) 

• Faculty committees, and to 

a slightly lesser degree colleagues' i 
opinions, still play a starring role j 
in evaluating teaching j 

• Self-evaluation has picked ! 
up considerable support (It was | 
"always used" by only 36 6 per- i 
cent of institutions in 1978.) 

• Classroom visits, along with 
course .syllabi and exams, have 
gained significantly in importance 
(In fact, in 1978 only 14 3 percent 
of institutions "always used" the 
former, and only 13.9 percent 
the latter ) 

• Reliance on the professor's 
scholarly research/publication 



as an index of teaching perfor- 
mance is more widespread now 
(The source rated only 19 9 per- 
cent in 1978 ) 

• Overall, things increased in 
importance more often than they 
decreased From this I conclude 
that colleges now emphasize a 
wider range of factors in the 



search for more accurate and 
in-depth evaluations of faculty 
performance 

It IS clear that evaluation 
methods are changing— especially 
when current practices are com- 
pared with those in place in 1978 
But, what is left unresolved as 
yet is which of the changes 



n^present improvement and which 
are experimental question marks 
Mure certain is a growing con- 
viction among many close 
observers of higher education 
that a direct outgrowth of 
improved evaluation practices 
wiiJ be improv-ement in teaching 
performance m 



